INPUT 
12 



10 



LANGUAGE 
PROCESSING SYSTEM 



LANGUAGE 
MODEL 



OUTPUT 
14 

FIG. 1 



140 



UNIFIED LANGUAGE MODEL 



N-GRAM 
CONTAINING 

NON- 
TERMINALS 



CONTEXT-FREE 
GRAMMAR 



FIG. 4 



OPTICAL 
DISK 61 



REMOVABLE 
ST©1?AGE 



FIG. 2 



COMPUTER 50 



OPTICAL DISK 
DRIVE 60 



MAGNETIC DISK 
DRIVE 58 



HARD DISK 
DRIVE 57 



INTF64 -, 



CPU 
51 



INTF 63 



INTF 62 



VIDEO 
ADAPTER 
78 



53' 



ROM 54 
BIOS 56 


MEMORY 52 
RAM 55 


OPERATING 
SYSTEM 65 


PROGRAM 
MODULE 67 


APPLICATION 
PROGRAMS 66 


PROGRAM DATA 68 



MIC 
92 



SPK 
83 



KEYBOARD 70 



TABLET 
71 



□ 

MOUSE 
72 



NETWORK 
ADAPTER 
83 



SERIAL PORT 
INTERFACE 76 



MODEM 84 



MONITOR 
77 




REMOTE 
COMPUTER 
79 



MEMORY 
80 



/ WAN^ 



SPEECH 



MICROPHONE 92 



O 

m 

m 
m 
m 

m 
m 

si 

P 

& 

P 

q 




AID 104 



FEATURE 
EXTRACTION 
106 



100 



TRAINER 105 



SEARCH 
ENGINE114 



LEXICON 110 



LANGUAGE 
MODEL 16 



ACOUSTIC 
MODEL 
(SENONE 
TREE) 112 



OUTPUT 
TEXT 



FIG. 3 



162 



OBTAIN A PLURALITY OF 
CONTEXT-FREE 

GRAMMARS 
REPRESENTING 
SEMANTIC OR 
SYNTATIC CONCEPTS 




164 



PARSE TASK- 
INDEPENDENT CORPUS 



REPLACE WORD 
OCCURRENCES WITH 
NON-TERMINAL TOKENS 



BUILD N-GRAM MODEL 



OBTAIN SECOND 
PLURALITY OF CONTEXT- 
FREE GRAMMARS FOR 
SELECTED APPLICATION 



166 



168 



170 



FIG. 5 



182 



OBTAIN A PLURALITY OF 
CONTEXT-FREE 

GRAMMARS 
REPRESENTING 
SEMANTIC OR 
SYNTACTIC CONCEPTS 




184 



PARSE TASK- 
INDEPENDENT CORPUS 



186 



REPLACE WORD 
OCCURRENCES WITH 
NON-TERMINAL TOKENS 



BUILD N-GRAM MODEL 



188 



OBTAIN SECOND 
PLURALITY OF CONTEXT- 
FREE GRAMMARS FOR 
SELECTED APPLICATION 



190 



FIG. 6 



202 



OBTAIN A PLURALITY OF 
CONTEXT-FREE 

GRAMMARS 
REPRESENTING 
SEMANTIC OR 
SYNTATIC CONCEPTS 
OF SELECTED 
APPLICATION 



204 



GENERATE WORD 
PHRASES FROM 
CONTEXT-FREE 
GRAMMARS 



206 



FORMULATE QUERY 
USING WORD PHRASES 



208 



QUERY TASK- 
INDEPENDENT CORPUS 



210 



RETRIEVE TEXT 
INDENTIFIED BY QUERY 



212 



FIG. 7 



BUILD LANGUAGE MODEL 
USING INDENTIFIED TEXT 



OBTAIN A PLURALITY OF 
CONTEXT-FREE 

GRAMMARS 
REPRESENTING 
SEMANTIC OR 
SYNTATIC CONCEPTS 
OF SELECTED 
APPLICATION 



202 



204 



GENERATE WORD 
PHRASES FROM 
CONTEXT-FREE 
GRAMMARS 



206 



FORMULATE QUERY 
USING WORD PHRASES 



1 



208 



QUERY TASK- 
INDEPENDENT CORPUS 



210 



RETRIEVE TEXT 
IDENTIFIED BY QUERY 



222 



PARSE IDENTIFIED TEXT 



J 



224 



REPLACE WORD 
OCCURRENCES WITH 
NON-TERMINAL TOKENS 



J 



212 



BUILD LANGUAGE MODEL 
USING IDENTIFIED TEXT 



J 



FIG. 8 




6 



CO 

CN\ 



00 
CO 
CN - 



\ 



I Q 

' uj y . 

\ I CO LL fc 

L_l S? 1 2 

co/ I 9 
8 L J 



_J_ 



o 

CN 



a 

? li- 
< o 



L_J 



